Manifold Estimation in View-Based Feature Space for Face Synthesis across Poses
نویسندگان
چکیده
This paper presents a new approach to synthesize face images under different pose changes given a single input image. The approach is based on two observations: 1. a series of face images of a single person under different poses could be mapped to a smooth manifold in the unified feature space. 2. the manifolds from different faces are separated from each other by their dissimilarities. The new manifold estimation is formulated as an energy minimization problem with smoothness constraints. The experiments show that face images under different poses can be robustly synthesized from one input image, even with large pose variations.
منابع مشابه
Manifold Estimation in View-based Feature Space for Face Synthesis Across Pose
This paper presents a new approach to synthesize face images under different pose changes from a single input image. The approach is based on two observations: 1. face images from a single person under different poses could be mapped to a smooth manifold in a unified feature space. 2. the manifolds from different faces are separated from each other by their similarities. The new manifold estima...
متن کاملFace View Synthesis Across Large Angles
Pose variations, especially large out-of-plane rotations, make face recognition a difficult problem. In this paper, we propose an algorithm that uses a single input image to accurately synthesize an image of the person in a different pose. We represent the two poses by stacking their information (pixels or feature locations) in a combined feature space. A given test vector will consist of a kno...
متن کاملThree-dimensional face pose estimation based on novel nonlinear discriminant representation
We investigate the appearance manifold of different face poses using manifold learning. The pose estimation problem is, however, exacerbated by changes in illumination, spatial scale, etc. In addition, manifold learning has some disadvantages. First, the discriminant ability of the low-dimensional subspaces obtained by manifold learning often is lower than traditional dimesionality reduction ap...
متن کاملMulti-modal Face Pose Estimation with Multi-task Manifold Deep Learning
Human face pose estimation aims at estimating the gazing direction or head postures with 2D images. It gives some very important information such as communicative gestures, saliency detection and so on, which attracts plenty of attention recently. However, it is challenging because of complex background, various orientations and face appearance visibility. Therefore, a descriptive representatio...
متن کاملIncremental Unsupervised-Learning of Appearance Manifold with View-Dependent Covariance Matrix for Face Recognition from Video Sequences
We propose an appearance manifold with view-dependent covariance matrix for face recognition from video sequences in two learning frameworks: the supervised-learning and the incremental unsupervisedlearning. The advantages of this method are, first, the appearance manifold with view-dependent covariance matrix model is robust to pose changes and is also noise invariant, since the embedded covar...
متن کامل